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Abstract 

We investigate a nonlinear dynamical system which "remembers" preselected 
values of a system parameter. The deterministic version of the system can 
encode many parameter values during a transient period, but in the limit of 
long times, almost all of them are forgotten. Here we show that a certain type 
of stochastic noise can stabilize multiple memories, enabling many parameter 
values to be encoded permanently. We present analytic results that provide 
insight both into the memory formation and into the noise-induced memory 
stabilization. The relevance of our results to experiments on the charge-density 
wave material NbSe^ is discussed. 

I. INTRODUCTION 

This paper concerns a nonlinear dynamical system with many degrees of freedom which 
organizes to store memories, in that a configuration- dependent quantity is driven to take on 
preselected values. In Ref. Q it is shown that in the absence of noise, the system encodes 
many memories during a transient period, but in the limit of long times retains no more 
than two of them. Thus, the purely deterministic system "learns," and then it "forgets." 

We examine the effects of adding noise to this system and demonstrate that certain types 
of noise can stabilize multiple memories so that they are remembered permanently. This noise 
stabilization is possible because the memory formation mechanism is fundamentally local, 
whereas forgetting is governed by the large-scale behavior of the system. Thus, it is possible 
for certain types of stochastic noise to modify the behavior at long wavelengths without 
destroying the local nonlinear dynamics which give rise to memory creation. 

We argue that the type of noise that we have found to stabilize multiple memories is 
likely to be present in some experiments on charge-density wave (CDW) conductors such as 



*Present address: Physics Dept., MIT, Cambridge, MA 02139 

^Present address: Math Dept., University of Chicago, 1100 E. 58th St., Chicago, IL 60637 



1 



NbSe-z- Thus, our results could explain the experimental observation of multiple apparently 
permanent memories encoded in individual samples reported in Ref. 

Our analytic investigations of the behavior of this system both with and without noise 
show that insight into the mechanisms underlying memory formation as well as noise sta- 
bilization can be obtained by averaging the dynamical equations over intermediate time 
periods. We determine analytically the dependence of the memory values on the noise pa- 
rameters in the limit when a certain parameter k tends to zero. The large-scale behavior of 
the system follows closely that of a linear diffusion equation; we present analytic bounds on 
the differences between the evolution of the nonlinear equations and that of the linearized 
system that are uniform in time and logarithmic in the system size. Some of the analytic 
results for the system without noise were asserted but not justified in Ref. 0]. 

The paper is organized as follows. Section |TJ briefly reviews the deterministic version 
of the model. Sections [III] and [TV] present our numerical work demonstrating that noise 
can stabilize multiple memories. Section [V] presents our analytic work which enables us 
to understand why noise can keep memories from being forgotten and also presents an 
averaging procedure which allows us to obtain analytic insight into the transient memories 
present in the map without noise in a certain limit. Section [VT] discusses our main results 
and possible relevance to CDW experiments. Appendix A demonstrates the uniqueness of 
the limit obtained by the averaging procedure of section |V| and also discusses explicitly 
this limit for the case of multiple memories. Appendix B compares the time evolution of 
the full nonlinear system with the time evolution of a linearized model and shows that the 
linearized equations reproduce accurately aspects of the evolution on large scales (though 
not the memory formation itself). 



II. THE MODEL 

First we present the model with no noise, which is the system of coupled maps studied 
in Ref. M: 



Xj(t + 1) = Xj{t) + floor 



k £ Mt)- Xj {t)) -A(t) 



i (nn) 



Here, i,j are the site indices, the sum is over nearest neighbors, t is a discrete time index, 
and floor [z] is the largest integer less than or equal to z. This system of maps can be derived 
from continuous-time differential equations describing the purely dissipative evolution of 
the positions Xj of N particles in a deep periodic potential, with nearest neighbor particles 
connected by springs of spring constant k <^ 1 (see inset, figure 1), in the presence of force 
impulses (—A(t) + |) These equations describe the dynamics of sliding charge- density 

waves (CDW's), 0|||7]|, and are closely related to models of a variety of dynamical systems 
0. In this paper we will consider explicitly only one-dimensional systems of N degrees of 
freedom with one free and one fixed end, xo(t) = and XN+i(t) = Xjsf(t), starting from the 
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initial condition Xj(t = 0) = 0. However, it is straightforward to generalize almost all the 
results to a variety of different boundary conditions and to more dimensions. 

The memory formation that occurs as these maps evolve is manifest in the discrete 



curvature variables 10 



Cj (t) = k £ ( Xi (t)- Xj (t)) . (2) 

i (nn) 

It will be useful to write the dynamical equations in terms of the curvature variables Cj(t) 
rather than the particle positions Xj(t). The equations of motion for the c's are: 

Cj(t+ 1) - Cj(t) = 

k {floor [c j+1 (t) - A(t)] - 2 floor [ Cj (t) - A(t)] + floor [cj_i(t) - A(t)}} ; (3) 
the fixed chain boundary conditions are |l 1 

c (t) = A(t) , (4) 
CN+i(t) = c N (t); (5) 

and the initial conditions are 

Ci(t = 0) = , % ± 0. (6) 

Figure 1 shows for these initial conditions the curvature variables Cj(t) versus time t for 
a five-particle chain when A(t) is cycled sequentially through five different values. Memory 
encoding is manifest by the tendencies of c's to take on values where frac(c) = frac(A(t)), 
where frac(z) = z — floor(z). That the curvature variables take on values whose fractional 
part is equal to the fractional part of the force impulse in the maps implies that for the 
balls and springs, just at the end of each force pulse a significant fraction of the balls are 
found near the tops of their potential wells ||. The system "memorizes" the force values 
and adjusts itself so that the balls are at the well tops just as the pulses end. 

As seen in Ref. |lj and here in figure 1, if a repeating sequence of pulses of different 
lengths is applied, then for a while all the values are encoded. However, at long times the 
system eventually reaches a fixed point where it stops evolving. At the fixed point, the 
curvatures are all the same; only one memory is remembered. We have found that using 
periodic, free, and fixed boundary conditions for the x's, changing the initial conditions, and 
incorporating quenched (time-independent) randomness to the model do not increase the 
number of memories retained at the fixed point beyond two. 

Here we investigate how this system can be modified so that it can remember more 
memories permanently. We show that certain types of stochastic noise which are likely to be 
present in some CDW experiments can do this and study both numerically and analytically 
the reasons for the multiple-memory stabilization. We show that the stabilization of many 
memories arises because the noise contains a deterministic component which causes the 
curvature variables to sustain a large scale spatial variation even in the limit of infinite time. 
The purely stochastic elements of the noise act to destabilize the memories; we will see that 
these destabilizing effects vanish in the limit k — ► 0. 

The following two sections presents our numerical investigations of the model with noise. 
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III. TECHNIQUE: ADDING NOISE 



Noise terms can be added to Eq. ([!]) in a variety of ways. Noise which is uncorrelated 
in both space and time, or uncorrelated in time but spatially uniform (e.g., fluctuations in 
the pulse amplitudes) does not lead to memory stabilization. However, we have identified a 
type of noise which is physically plausible that stabilizes multiple memories. 

The memory- stabilizing noise we study here is defined by modifying Eq. (P as follows. 
Every r time steps, an index jr> with 1 < jo < N is selected, and for all j > jo, the positions 
of balls jo through N are shifted by a fixed integer X || 

-r a 4- u = S + floor [ c ^) - Mt)\ + x if 3 > 3d m 

j{ + ' \ Xj(t) +floor[ Ci (t) - A(t)\ otherwise. { ) 

The relative positions of all the balls are unchanged except for the distance between Xj D and 
Xj D -i, so the disruption is local. 

Equivalently, one can write the map with noise in terms of the curvature variables, as 

Cj(t + 1) - Cj {t) = k {floor[c J+ i(t) - A(t)\ - 2 floor[ Cj (t) - A(t)\ 

+ floor [c 3 -_i(t) - A(t)]} + kXS t{mod t)j0 (Sjjjj..! - 5 j>jD ) , (8) 

where the Kronecker delta Sij is unity if i and j are identical and zero otherwise. In either 
formulation, the noise does not affect the boundary conditions. 

This type of noise models the physical process of breaking the spring connecting balls 
jo and jo — 1 and then subsequently reconnecting them with a spring of longer unstretched 



length [12| . This choice of noise is motivated by phase slip processes known to occur in CDW 
materials ||13|| . When the model is applied to CDW's, the variable Xj in Eq. (0) is interpreted 
as the phase of the charge density wave at the j th impurity site in the sample, measured 
relative to an undistorted configuration [|l4Hl6[1. If a phase slip causes an extra wavelength 



of the CDW to be inserted between two impurities, then the "unstretched" phase difference 
between two impurity sites increases. 



IV. NUMERICAL RESULTS 

Fig. ^a shows the behavior of a system identical to that of Fig. [I], except that noise has 
been applied (Eq. (|^)), using the parameter values X = 9 and r = 13. Fig. ^]b shows the 
time evolution in the presence of noise for a smaller value of k. Otherwise the parameters in 
Fig. |2]a and Fig. ||b are identical; in both cases, the index jc in Eq. (0) was selected randomly 
and with equal probability from the indices 1,...,N. Fig. [| demonstrates that when noise 
is present, more memories are stable at long times than for the noiseless case, Fig. [I]. The 
noise also exhibits a destabilizing effect, as evidenced by the fluctuations in the curvature 
values. As comparison between Fig. [|a and Fig. [|b demonstrates, these fluctuations become 
smaller as the parameter k is decreased. Numerically we find that at times t Q long enough 
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that the behavior appears to be stationary, the standard deviation of the curvatures from 



their memory values A 



-t +T 
;t=t +l 



1/2 



is proportional to k as k —>■ 0. 



Changing the parameters X and r can change the number of different stable memories 
and their values. Below we will show that the memory values attained by each particle in the 
system can be calculated analytically by averaging the equations of motion of the system. 



A. Deterministic Noise 

In the numerical simulations shown in Fig. |2|, the index jo was chosen randomly and with 
equal probability from the indices 1, . . . , N. It is useful to consider a "deterministic" version 
of noise, where rather than selecting jo randomly, jo is cycled systematically through the 
indices 1 to N, so that each index is selected exactly once during each noise cycle. (We refer 
to a "noise cycle" as the Nt steps it takes to make a complete cycle through the indices 1 to 
N.) One such choice, used for our numerics, is to cycle through the indices in order, so that 

xj(t + 1) - x^t) = floor[ Ci (t) - A(t)] + X6 t{mod r) , 6+(j - ^(mod N) + l), (9) 

where 9+(y) = 1 if y > 0, and zero otherwise. The behavior is substantially identical for 
any sequence in which each index is chosen exactly once per noise cycle. 

Our numerical investigations of the evolution of Eqs. (^) over a wide range of parameters 
and initial conditions indicate that eventually the system always reaches a periodic orbit. 
The period of the observed cycle is either equal to or a divisor of NrM, where again N is 
the number of balls, r is the interval between noise pulses or kicks, and M is the number 
of memories. Fig. ||| is a plot of the time evolution of the Cj(t) for a five-ball system 
(N = 5) with the same parameter values as Fig. |2|, but with deterministic kicks. The gross 
features of the curves are very similar, but the fluctuations in the curvature values observed 
for stochastic noise have been replaced by a regular, repeating pattern (Fig. [| shows an 
expanded view of this pattern for two of the Cj's). The excursions during the cycles have 
amplitude proportional to k. These regular cycles facilitate analytic investigation of the 
dependence of stable memories and their values on the parameters X and r. The number of 
memories remembered at long times when k is small depends systematically on the ratio X/r 
and not on X and r separately. Figure [| shows numerical results for the dependence of the 
long-time memory values on X/r and demonstrates the good agreement with the analytic 
predictions presented in the next section. 



V. THEORETICAL ANALYSIS 

In this section we show how various aspects of the behavior of the maps both with and 
without noise can be understood analytically in the limit that k — > 0. In subsection ([V A| ) 
we discuss the map with deterministic noise. The observation that at long times a periodic 
orbit is always reached can be exploited to predict the dependence of the long-time memory 
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values on the noise parameters X and r. A key ingredient in this analysis is the examination 
of the time-averaged equations of motion of the system. 

In subsection ( |V B| ) we address the model without noise. Because in this case most of the 
memories are transient and therefore are no longer present when the fixed point is reached, a 
modified averaging procedure must be used. This procedure yields insight into the transient 
memories and enables us to demonstrate that a well-defined k — > limit of this model exists. 



A. Long Time Behavior of The Map with Noise 

As Fig. [5] makes evident, there is domain structure to the dependence of the value and 
number of stable memories on X/r for the map with noise, Eqs. (|7|). Here we calculate 
analytically the structure of these domains when k <C 1 by finding the memory value of each 
site as a function of the system parameter X/r. 

The equation of motion for the system is 

xj(t + 1) - Xj (t) = floorfo- (t) - A(t)} + X6+(j - j D (t))6 t[mod r))0 , (10) 

where 9 + (y) is defined after Eq. (H). The j'd's are selected so that the probability that 
jD{t) — n is P n - We examine first the case of deterministic noise and discuss stochastic noise 
at the end of the subsection. 

We define an averaging time T ave = NMt and 

uAto) = ^ i0+ E 'floarfoCt) - A(t)] . (11) 

1 ave t=t 

Averaging Eq. (|10D over a time T ave yields 

1 j ' X 

'Xj(t + T ave ) - Xj(t )) = Uj(t ) + p n— ■ (12) 



1 ave n= i T 

When t is large enough so that Xj(t + T ave ) = Xj(t ) for all j, Eq. flI2|) implies that the 
Uj(t ) are independent of to (hence we drop the argument) and must satisfy 

u, = --Y j P n . (13) 

T n=l 

One can also derive Eq. fllTf ) directly in terms of the curvature variables Cj(t) = k(xj + \(t) — 
2xj{t) + Xj_i{t)). Averaging Eqs. (H) over a time interval T ave yields 

1 X 

— - [ Cj (t + T ave ) - Cj (t )] = u j+1 (t ) - 2uj{to) + tij-i(to) + (Pj+i ~ Pj) — , J ^ A, (14) 

J- ave 7~ 

= %+i(to) -2%(to) + %-i(to) ~Pn— , j = JV. (15) 

r 
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If tjt— [cj(t + MNt) — Cj(t )} = 0, as is true for a periodic orbit, one has 



u N ~ u N -i = -P n X/t , 
Uj+i - Uj + Pj+iX/t = Uj 



u^ + PjX/t (1<j<N). 



(16) 



Eq. ( |16"D implies that Uj—Uj-i+PjX/r is independent of j, which together with the boundary 
conditions again yields Uj = — — J2n=i Pn- 

For simplicity, assume that none of the A m are exactly an integer |T7| and label the values 
of A m such that < frac(Ai) < frac(A 2 ) < . . . < frac(AM) < 1. We now show that when 
k —>■ 0, every particle is almost always on a memory. Only for a set of P n of measure zero 
are some particles in the system not on memory values as k — > 0. At long times, the j th 
curvature is on the £* th memory (cj(t — > oo) obeys frac[cj(t — > oo)] = fracfA^*] + Oik)), 
where the memory index £* is 



1 + floor 



- M floor 



V J 

-M— Y, Pn 

T n=l 



M 



+ Y, fl ° 0r \ A r 



m=l 

M 



1 n =l 1V1 m=l 



(17) 



Perhaps surprisingly, which ball is on which memory does not depend on the memory values 
frac(A m ). This analytic prediction is completely consistent with our numerical observa- 
tions; this agreement is illustrated by the consistency of the analytic and numerical results 
presented in figure ^[ 

We derive Eq. fll7D by writing Cj(t) = Cj + 5cj(t), where each Cj is an integer independent 
of t, and Scj(t) obeys < 5cj(t) < 1 for all t. This decomposition can always be done if k 
is small enough because the maximum excursion of each Cj during the averaging interval is 
proportional to k, and every Cj will turn out to be on a memory and hence not at an integer. 
We define 5A m = A m — floor(A m ) and 



Suj 

and rewrite Eq. (p~3|) as 
X 



1 



to+T ave — 1 



/»< - Jfr ^ (floor[5c,(t) - 5A(t)}) 5 A(t)Ari 



t=to 



'iYPn 



n=l 



■y M y M 

— Y flooKAn) + V7 Y 5U irr t 
1V1 m=l m m=l 



(19) 



Now Suj m = —1 if Scj(t) < 5A m and Sv,j m = if Scj(t) > 5A m for all t during the averaging 
interval. Since the excursions during this interval are proportional to k, they vanish as 
k — 0; thus when k is small enough the j ball cannot cross more than one memory value 
during a cycle. Therefore, we can write Dm=i ^jm = — 1 + Qj + Pji where Qj is an integer 
satisfying < Qj < m — 1, and the pj satisfy < pj < 1. Thus we have 
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X 



M 



- - E P n + E flOOT ( A -) + 1 = ^ + + 



n=l 



m=l 



M 



(20) 



with Cj and Qj integers. 

For simplicity we assume here that MX/rJ2n=i Pn is n °t an integer for any j < N, a 
condition which will ensure that pj < 1, and hence -h{Qj + Pj) < 1 [IE]- Taking the floor of 
both sides of Eq. ( f20l) yields 



Cj = floor 



v i i M 

' n =l JW m=l 



+ 1 . 



(21) 



Multiplying Eq. ( pH|) by M and then taking the floor of both sides yields 



Qj = floor 
- M floor 

which in turn implies 

Pi ~- 



V j 



M 



+ ]T floor [A T 



m=l 



M 



7E^4e^[^ 

' n=l iw m=l 



(22) 



X 3 

M— J2 p n~ fl oor 

T n=l 



-M- x: ^ 

r n=l 



(23) 



We see that it is consistent to assume that < pj < 1 so long as (MX/ r) Y? n =i Pn is not 
exactly an integer. Since pj can only be fractional if Cj crosses a memory during the averaging 
interval, as k — > each Cj must be on a memory. Since determines the memory index via 
i*. = Qj + 1, one obtains Eq. (|T7|). 

Finally, to demonstrate consistency of the assumption that no particle can be on more 
than one memory, we must show that the particle excursions over the averaging time are small 
as k —>■ 0. This is easily done starting from the equation of motion for the curvatures Eq. (|) 
and noting that our solution for the Uj satisfies Uj + i — 2uj+Uj_ 1 = 0. If no memory is crossed, 
then the absolute value of the difference between the time average J2 t t ° +Tave floor [cj(t) — 
A(t)]5A(t),A m an d the corresponding floor[cj-(t) — A{t)]5A(t),A m cannot be bigger than unity. 
This bound implies that until a memory is crossed, the excursion per unit time of each of the 
c's cannot be bigger than k(4 + X). Since the memory values are separated by an amount 
of order unity, as k — > the number of steps needed to reach the nearest memory diverges 
as 1/k, and the excursion during the averaging time cannot be greater than k(4 + X)T ave . 



1. Importance of Spatial Distribution of the Noise 

So far we have mainly discussed the case of spatially homogeneous noise, P n = 1/N for all 
n, and seen that if the noise causes each spring in the chain to break with equal probability, 
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multiple memories can be stabilized indefinitely. However, in our analytic work we did not 
assume this special form for P n , and one may ask whether the same results are obtained if, 
for instance, only the first spring were broken repeatedly. 

We address this issue by examining Eq. (|T7|) . Note that if Pi = for some I, then particles 
I — 1 and I must be on the same memory value. Thus, if only the first spring is repeatedly 
broken, there will be only one memory observed at long times, although its value may be 
different than in the noiseless case. However, the P n need not all be equal for multiple 
memories to be stable at long times. 

2. Stochastic Versus Deterministic Noise 

Now we discuss the behavior when the system is subject to stochastic noise rather than 
deterministic noise. The crucial point here is that the equations of motion can always be 
averaged over some time interval T ave , and so long as all the c/s stay roughly constant, there 
is no need for there to be a truly periodic cycle for the procedure above to apply. As k — > 
the memory values will be exactly the same for random noise as for deterministic kicks with 
the same time-averaged spatial distribution of events. 

Not surprisingly, the excursions of the curvatures about the memory values are larger for 
stochastic noise than for sequential kicks, all other parameters being held fixed. There are 
two mechanisms by which stochastic noise would enhance the size of the excursions. The 
first is that the small motions of the curvatures about their memory values are more erratic 
because the noise kicks are inhomogeneously spaced in time, and the second is that fluctua- 
tions in the noise may temporarily cause the system to be driven to a memory value other 
than that determined by the time-averaged X/t. Numerically we find that the excursions 
in systems with stochastic noise are typically a few times the excursions observed in the 
deterministic case with the same parameters, and that their magnitude is proportional to k. 
These observations are evidence that the first mechanism is dominant; the second mechanism 
leads to a nonlinear dependence of the excursions on k and also, since it depends on how far 
each curvature is from the edge of the parameter range in which the memory in question is 
stable, leads to sensitive dependence of the excursion magnitudes on X and r. 

B. The behavior of the map without noise as k — > 

In this subsection we show that a modified averaging procedure can be used to obtain 
insight into the time evolution of the system. 

Above, we used the observation that at long times the behavior of the map with noise 
is periodic in time to calculate how the memory values depend on the system parameters. 
A key step in this calculation is averaging the equations of motion of the system over an 
appropriate time interval. Here we present an averaging procedure applicable in the limit 
k —>■ that can be used to obtain insight into the time evolution and not just the long time 
behavior. 
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Analyzing just the long-time behavior cannot yield insight into transient memories, be- 
cause in this limit almost all the memories have been forgotten. Therefore, the technique 
we used in the previous subsection of looking only at fixed points of the equations of motion 
is not so useful here. However, Fig. ^, which shows the evolution of the curvatures for the 
system with no noise (the same numerical data as Fig. [I] on an expanded scale), demonstrates 
that during the motion two types of particles exist — sites whose curvatures are "stuck" on a 
memory values, and curvatures that are in transit between different memory values ( "drift- 
ing"). A "stuck" site oscillates periodically about a memory value until a neighbor changes 
its status, at which time the stuck site can either change its oscillation about the same 
memory, or can start to drift. As k is decreased, it takes more and more time steps for the 
drifting sites to get between different memories, during which time they provide a constant 
environment for their neighbors. In contrast, the period of the cycles of the "stuck" sites 
remains unchanged as k — > 0; moreover, the amplitudes of the excursions about the memory 
values are proportional to k. In the limit k — > 0, the drifting sites comprise a quasi- stationary 
environment for the stuck sites, and one can average the equations of motion over the period 
of the stuck sites' cycles. 

For simplicity, in this subsection we consider only the case of a single memory with A = 0. 
The generalization of the analysis to different memory values and to multiple memories is 
straightforward, and is discussed briefly in Appendix A. We only discuss here the model in 
the absence of noise, but the analysis is easily extended to the case when noise is present, if 
desired. 

The equations of motion for the Cj(t) are 

Cj (t + 1) = cj(t) + k (floor [c j+1 (t)\ - 2floor[ Cj (t)] + floor^-^t)]) . (24) 

First consider the behavior of a site j whose two neighbors' curvatures are both drifting 
between integers. While the sites j + 1 and j — 1 are drifting, the quantities floor[c J+ i(i)] 
and floor [cj_i(t)] remain constant, and we can denote their (integer) values as Ij + i and Ij-i 
and define r] = (Ij+i + Jj_i)/2. Eq. fl24|) then becomes 

Cj(t + 1) - Cj (t) =2k{r}- floor[ Cj (t)]) . (25) 

If i] — floor[cj(t)] > 0, then Cj(t) will increase in time until 7] — floor[cj(t)] is no longer 
positive. If 7] is an integer, then Cj(t) will stick at 77, whereas if r\ is a half- integer, then Cj(t) 
will undergo a period-2 cycle about the integer value i] + 1/2. If initially r\ — floor (cj(t)) < 0, 
then eventually Cj(t) will stick just below rj + 1 if rj is an integer, and Cj(t) will oscillate in a 
period-2 cycle cycle about 77 + l/2if?yisa half-integer. 

If there are L stuck sites in a row, then the cycles of the sites become longer, but simple 
periodic behavior is still observed. We find numerically that the motion of each site in a 
stuck region with L sites is a cycle of length L + 1 or shorter. Moreover, every time a 
site changes its status (for instance, a drifting site might come within O(k) of a memory 
value), the new cycle gets established in a time that remains finite as k — > 0. Therefore, as 
k — > 0, during the periods when the drifting sites at the boundaries of the region in question 
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remain between memories, we can average Eqs. (|24] ) over the cycle of length p. Defining 
Uj = \ Y!t=tl+i floorfc^t)], we obtain 

Cj(t + p) — Cj(t) = k (Uj + i — 2uj + Uj-i) . (26) 

All the terms on the right hand side of Eq. ( p6|) are time-independent, implying that 

Cj(to +p) = Cj(t ) + (kp)rj , (27) 

with Tj = Uj+i — 2uj + Uj-\. Moreover, we can rewrite Eq. ( |24"D during the averaging interval 

as 

Cj (t + 1) = cj(t) + krj + kAj(t) , (28) 

where Aj(t) = floor [c.,- + i(t)] — — 2(floor[cj(£)] — Uj) + floor [cj_i(t)] — Uj^i has zero mean 
and is periodic with period p. Also, because floor(cj) of a stuck site does not change by more 
than ±1, we have |Aj(t)| < 4. Therefore, we can write the complete solution of Eq. (|24|) for 
the interval where all the stuck sites have settled into their periodic behavior and none of 
the drifting sites goes through an integer as 

Cj (t + l) = Cj (to) + {H)r j + k Vj (l) , (29) 

where is periodic in time and satisfies |^j(/)| < 4max{pj} < 4N for all j and /. The first 
two terms represent the piecewise linear solution and the last term represents the cycles of 
amplitude of order k superimposed on the piecewise linear solution. Note that the difference 
between the piecewise linear part of the solution and the complete solution goes to zero as 
k -> 0. 

We can define a rescaled time variable t = k*t and take the limit of Eq. (p9|) with k — >• 0, 
kl finite, in which the Uj (and hence rj) are independent of k. The existence and uniqueness 
of this limit is demonstrated in Appendix A. In this limit, the solution converges to 

c^to + t) = Ci (t ) + ri t. (30) 

If a site j is drifting, we set Uj = floor(cj), whereas if it is stuck, Uj is determined by requiring 

Tj = Uj + i — 2uj + Uj-i = . (31) 

When there are L stuck sites in a row (say sites ^ J0 +i, . . . , Uj 0+L , with Uj and Uj 0+ L+i given), 
then the Uj in the stuck region are obtained by solving Eq. Q3T]), yielding 

«i = «n+( Uio+ Ll~ US ° )U-3o). (32) 

Whenever all the Uj are fractional, every site in the region must be on a memory. The values 
of Uj a+ i and Uj 0+ L enter into the drift rates of Cj and Cj 0+ L+i and hence must be determined 
to obtain the time evolution of those sites. 
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One still needs to consider the behavior at the transitions when the sites change between 
stuck and drifting. Because the number of steps needed to establish the new cycle structure 
is finite and independent of k, these transitions are instantaneous in terms of rescaled time. 
Moreover, as we demonstrate in Appendix A, the values of the it's after each transition do 
not depend on the details of either the old cycle structure or of the transition. 

These considerations enable us to use the the piecewise linear solution Eq. (|30| ) to for- 
mulate a k = model. In the k = model, if a site i is stuck, then q is exactly an integer. 
Between transitions, 

^2 = Uj+1 - 2uj + Uj-t , (33) 

where the Uj are equal to the Uj that are defined for a system with non-zero k by averaging 
between the same two transitions. At each transition, the Cj are continuous. However, the Uj 
change instantaneously to the new values appropriate to the time interval after the transition 
but before the next transition. 

Thus we have been able to characterize the local dynamics, and describe the k — > limit 
of the model. However, we have not addressed the evolution of the large scale structure of the 
system. Ref. [0 presents numerical evidence that all the large-scale structure of the nonlinear 
equations is well-approximated by the evolution of linear equations of motion obtained by 
replacing floor [y] by y — \ in Eq. (||). As discussed in Ref. IJ, this observation enables 
one to perform accurate estimates of when memories form and when they are forgotten as 
a function of system size and model parameters. In Appendix B we present an analytic 
bound on the error in the evolution of the curvatures made when the dynamical equations 
are linearized and show that this error is bounded uniformly in time and logarithmically in 
the system size. 

In this subsection we have obtained the k — > behavior via an explicit limiting process 
of the dynamics with k ^ 0. In Appendix A we show that this limit is well-defined and 
prescribe how to define the k — > limit of the model without reference to averages of the 
k 7^ dynamics. We also sketch how to generalize the analysis of the k — > limit to apply 
to the case of multiple memories. 

VI. DISCUSSION 

We have investigated the behavior of a simple nonlinear dynamical system which has the 
capacity to encode memories. The deterministic system can encode many memories for a 
while, but at long times forgets almost all of them. Here we have demonstrated that there is 
a type of stochastic noise which enables the system to encode many memories permanently. 
The memory stabilization arises because the noise has a time-average with nontrivial spatial 
structure; in particular, it enables the curvature variables which describe the local force, to 
have large-scale variations even at long times. 

The disappearance of the memories in the absence of noise occurs only because the range 
of c's collapses at long times. For fixed, free, or periodic boundary conditions (which seem 
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most appropriate to physical realizations of balls and springs or of charge- density waves), at 
long times the values of Co and cat are the same. To stabilize many memories permanently, 
one must arrange things so that Co 7^ cn at long times. The "phase slip" noise studied here 
is one way to do this. In principle, another way to do this is to impose boundary conditions 
which enforce c 7^ c/v, but we do not know of a physically plausible way to do this in the 
CDW system p[. 

We now discuss possible consequences of our results for experiments on CDW materials. 
The experiments reported in Ref. |l| involved averaging over millions of applied pulses, and 
thus were probably measuring the number of memories retained in steady-state Q. In the 
experiment, the only samples which retained multiple memories had additional silver paint 
strips attached between the probe contacts. This perturbation on the system is important, 
because ordinarily one expects the phase slips to occur almost exclusively at the sample 
contacts, where the strains are largest |R| . The silver paint in the middle of the sample may 
induce spatially inhomogeneous phase slips; our theoretical results suggest that the spatial 
inhomogeneity of phase slips in a sample may be important in determining the number of 
memories retained at long times. Further experiments to quantify the spatial dependence 
of noise in CDW materials would help determine whether the theory is applicable to noise 
production in this experimental situation. 

Because the noise stabilization depends on the detailed spatial characteristics of the 
noise, it will be quite sample-dependent. On the other hand, in the absence of noise, the 
dependence of the duration of the transient memories on sample size follows from rather 
general arguments and should be robust [3|. Therefore, systematic investigation of the time 
evolution of the transient memory response in samples with as little noise as possible is 
therefore probably the most promising avenue towards making comparison between theory 
and experiment. 

In this paper we have shown that it is possible to obtain a rather complete theoretical 
understanding of our dynamical system in the limit of very weak springs, k — > 0. However, 
real CDW materials such as NbSe^ tend to be described by the model in the large-/c regime 
|20|j . Therefore, quantitative comparison between this theory and experiment cannot be 



expected. Understanding how the memory behavior evolves as k is made large and providing 
quantitative theoretical predictions in the regime relevant to experiment is an important 
subject for future investigations. 
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APPENDIX A: THE k LIMIT 



In Subsection ( |V B[ ) we denned the k — > limit of the model in terms of averages of 



the behavior of the model with nonzero k. In this appendix, we demonstrate that this limit 
is well-defined and show how to construct it without reference to the system with nonzero 
k. In A.I we discuss a single integer memory, while in A. II we consider briefly the rather 
straightforward generalization to the case of multiple memories. 

A.I: The k = limit 

We recall that our original model was defined in terms of a discrete time index t, and wish 
to introduce a rescaled time t = kt and consider the limit A; — ^ with t finite. The problem we 
are addressing is: Given values Cj(t) for j = 1, 2, . . . , N at some time t, can the corresponding 
Ujit) be generated uniquely? If so, then because -Jr = Uj+i(t) — 2uj(t) + Uj-i(i), the entire 
time evolution is determined. 

As stated, this problem is not solvable in general. This is because, even for a model 
with non-zero k, the Uj are not defined uniquely at a "transition" at which the sites go from 
one distribution of "stuck" sites or a given cycle structure to another. As an illustration, 
consider the system 

c a (t + 1) = c x (t) - k(u + u 2 - 2floor[c 1 (t)]) , (34) 

where u = and w 2 = 1. If initially Ci(0) = 1 + 7k/ 2, we have ci(t) = 1 + (7 — 2t)k/t, 
t < 4 and Ci(t) = 1 - (-l)*Jfc/2, t > 4. On the other hand, if initially c x (0) = 1 - 7Jfe/2, then 
Cl (t) = 1 - (7 - 2t)jfe/t, t < 4 and ci(t) = 1 + (-l)*jfc/2, t > 4. Therefore, for t < 4, the two 
different initial conditions yield tti(O) = 1 and ux(0) = 0, respectively. As k — > 0, both these 
situations correspond to the same initial condition ci(0) = 1, and therefore it is clear that 
there is a transient period when Mi(0) is not defined uniquely. Nonetheless, since both initial 
conditions in the example yield U\(t) = 1/2 for t > 4k, in the limit k = it is consistent to 
define u^t) = 1/2 for all t > 0. 

Here we demonstrate that Ui(t) for t > can be defined uniquely for all possible initial 
conditions of the model with non-zero k that lead to the same initial configuration of c's as 
k — > 0. Specifically, we show that given values Cj(t ) for j = 1,2, ... ,N there is a unique 
consistent way to define Uj(t) for t such that t > t , valid up until the next transition. This 
fact, together with the observation that the functions Cj(t) are continuous, enables us to 
show that the k = limit of our model is well-defined. 

For the k ^ model, we have that Uj = floor(c.,) unless Cj is within O(k) of an integer 
m. If we are close to a transition, we cannot define the u/s for all the sites that are close to 
integers. However, recall that each transition takes a finite number of steps, and hence takes 
up zero units of the rescaled time i = kt as k — > 0. The Cj change in steps of 0(k), so the 
sites where Cj is initially close to an integer will have a Cj that is close to the same integer 
after the transition. After the transition, we have one of the following possibilities for these 
sites: 

1. The site j could be stuck (more precisely, the curvature of site j could be stuck) and 
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the value of Cj will execute a cycle (possibly of period 1) near the integer. In this case, 
we have m — 1 < Uj < m and the site has zero average drift. 

2. The site could be drifting up on average. In this case, Cj > m after the transition so 
that Uj = m. 

3. The site j could be drifting down on average. In this case Cj < m after the transition 
so that Uj = m — 1. 

Since we have that the average drift rate for the site j after the transition is given by 

dc 

-l^ Uj+1 (t)-2u j (t)+Uj_ 1 (t), (35) 

we have the following consistency conditions: 

Uj(t) > m — 1 implies that Uj+i(t) — 2uj(t) + Uj-i(t) > , 
Uj(t) < m implies that Uj + i(t) — 2uj(t) + Uj-i(t) < . 

These conditions are independent of k, and we require that the k = model satisfy them. 
In the k — model, a site can be stuck only if Cj is exactly an integer. If Cj is not exactly 
an integer, then since Cj(t) is continuous, we have 

u j(to+) = floor [9 (t )] , (36) 

where to + = \im t ^ 0+ u(t + e). If Cj(t ) = a is exactly an integer, we have that 

a — 1 < Uj(to+) < a. 

We can combine the preceding two equations to obtain 

u~(cj) < Uj < u + (cj), (37) 

where u~(x) = lim e ^o+ floor (a; — e) and u + (x) = lim e ^o+ floor (a; + e). The functions u + and 
u~ satisfy a monotonicity condition 

u~(a) < u + (a) < u~(b) < u + (b) (38) 

for all a < b (this follows from the fact that floor (x) < floor(y) if x < y). This implies that 
for any given value u, there is at most one value of c such that it is possible for a site with 
Cj = c to have Uj = u. This monotonicity gives the following consistency requirement on the 
definition of the Uj(t 0+ ): 

Uj(t 0+ ) > u~(cj(t )) implies that u j+1 (t 0+ ) - 2uj(t 0+ ) +Uj-i(t 0+ ) > , 

Uj(to+) < u + (cj(t )) implies that Uj + i(to+) — 2uj(t 0+ ) + -Uj_i(t +) < . (39) 



15 



For brevity, we will henceforth suppress the time arguments; Cj will represent Cj(to) and Uj 
will represent Uj(to+). 

We are trying to generate the Uj given the Cj so that the k = model is well defined. 
Given the Cj, we can take an initial condition of the form Cj = Cj + kFj, where the Fj is a 
given arbitrary bounded sequence, and choose k sufficiently small so that Cj is not an integer 
if Cj is not an integer and \5j — Cj\ < 1/4 for all j. Then the Uj obtained by following the 
dynamics in a model with finite k starting from this initial condition and looking at the 
averages after any initial transitions will satisfy the consistency requirements. However, it 
is not clear that this procedure gives a unique definition of Uj. 

To show that there is only one consistent way to define Uj for a given Cj, we assume the 
opposite. Let uj and u 2 be two distinct definitions for Uj that are both consistent. Both uj 
and u 2 satisfy the same boundary conditions, so that -uj — u$ = and u x N — u 2 N = 0. Since 
u 1 ^ u 2 , there is some index j* for which uj* — u 2 , ^ 0. Without loss of generality, we choose 
the labels so that uj, — u 2 * > 0. Since u\ — Uq = and — u 2 N = 0, there must exist indices 
p and q with p < j* < q such that u^ — u 2 < 0, u^ — u 2 < 0, and uj — u 2 > for all p < j < q. 
By Eq. (P7|), u 2 > u~(cj), so that uj > u~(cj) for all p < j < q. Eq. (|3§| ) therefore requires 
that uj +1 + uj_ x — 2uj > for all p < j < q. Eq. fl37|) also implies that ttj < u + (cj), so that 

< u + (cj) for all p < j < q. Eq. (|39| ) therefore requires that + u 2 __ x — 2u 2 > for all 
p < j < q. Combining these two results, we have 

{u) +l - u 2 +1 ) + {u]_ x - u 2 ^) - 2{uj - u 2 ) > 

for all p < j < q. This implies that if uj — u 2 attains a maximum on p < j < q, it is a 
constant for p < j < q. Therefore, uj — u 2 < max(«p — u 2 , u^ — u 2 ) = for all p < j < q. 
This contradicts our assumption that uj, — u 2 , > 0, and proves that there can be only one 
consistent definition of Uj given Cj. This proves the claim from section [V]that averaging over 
the cycles in a k ^ model gives a consistent k = model. 

Now we present a prescription for generating the Uj from the Cj without any reference 
to the k model. The process consists of identifying all sites whose u's must be integers, 
requiring that all the remaining w's satisfy Uj+i — 2uj + Uj_i = 0, and checking to see whether 
all the constraints are satisfied. If not, then there is at least one additional site whose u is 
an integer, and one such site is identified. This process is iterated until all the constraints 
are satisfied. 

First consider the situation where u = u p = 0. We are given a sequence Cj (0 < j < p) 
and hence functions uf(c) and u^(c) that satisfy the monotonicity condition (^) for each 
< i < p. The dynamics of the Cj are determined by Eq. (^), and each Uj must satisfy the 
constraint uj(cj) < Uj < u^(cj). Our earlier results generalize to this case and it follows that 
there is a unique assignment of the Uj that satisfy the consistency conditions in Eq. (|3^). In 
this situation we have the following result: 

Claim 1: Let j* be an index where uj(cj) attains a maximum for < j < p and uj,(cj,) > 0. 
Then we must have uj, = uj*(cj*). 

Proof: Assume that this is not true. Then, we must have Uj* > uj,(cj,), and the 
consistency condition requires that Uj, + i + Uj,-\ —2uj, > 0. It follows that Uj* is not a strict 
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maximum for Uj for < j < p. Let < m < p be such that u m > Uj* . Since the maximum 
value for uj(cj) was attained at j = j*, it follows that u m > w~(c m ). Therefore, by the 
preceding argument with m in the place of j*, it follows that u m is not a strict maximum 
for Uj. Consequently, Uj < max(«o,tt p ) = for all < j < p. This contradicts the fact that 
the Uj are constrained to be greater than or equal to u~(cj) and uj*(cj*) > 0. 

A similar argument shows that if j* is an index where Uj{cj) attains a minimum for 
< j < p and Uj»(cj*) < 0, then Uj* = up(cj*). 

If uj(cj) < and Uj{cj) > for all < j < p, the preceding result does not give us any 
information. However, in this case we can set Uj = for < j < p. Since this assignment 
satisfies the constraint and the consistency conditions, by our earlier result, it is the unique 
consistent definition for Uj. 

Now we can solve the problem of assigning the Uj given the Cj for the k = model 
recursively. Assume that we know u p = a and u q = b with p > q. [26] Let 



q-i i-p 

Li = a h o . 

q — p q — p 

For p < i < q define uf(c) = uf(c) — li and Ui = Ui — Zj. Since lj + i + lj_i — 21 j = 0, it follows 
that we are precisely in the situation that we considered above. 

We set Uj = lj for all p < j < q and check to see if u~(cj) < and u^Cj) > for all 
p < j < q. If not, we find an index j* and fix Uj* as in Claim 1 above, and repeat the 
procedure for p < j < j* and j* < j < q. This determines all the Uj recursively in no more 
than iV steps. 

The Uj determine the time dependence of the c's via -J- = — 2uj + The 
complete solution between the transitions at t = t n and t = t n+ \ is given by 

Cj(t) = Cj(t n ) + rj(t - t n ) for t n <t < t n+1 . (40) 

A. II: Multiple Memories 
Now we extend our analysis of the k — > limit to the case of multiple memories. We find 

dc- 

-J = U j+1 - 2Uj + , (41) 



with the Uj given by 



i Pj- 1 

Uj = -J2 floor [c, (to +t)- A(t + *)] (42) 
Pj t=o 

if the site j is stuck in a cycle of period pj, and 

i Af-l 

u i = u E f loor (*o +t)-A(t + t)} (43) 

if the site j is drifting, i.e., the fractional part of Cj is not equal to the fractional parts of 
any of the forcings A(l), A(2), . . . , A(M). We define 
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m — floorlc, — e 

0+ M n L 3 

m=U 



^ M-1 



A(m)] 



(44) 



and 




m — floor [c,- 
o+ M ^ 



I M-1 



A{m)} . 



(45) 



Then we can assign the stuck sites and the drifting sites by the same procedure as for 
the single memory except that we replace u~ by U~ and u + by U + . 



In this appendix, we address the large-scale dynamics of the system by examining a 
linearized equation obtained by approximating the floor function in Eq. (|3|) with z — 1/2, 
yielding the linearized map: 



Although this linearized map contains no information about the memory formation, it cap- 
tures accurately the behavior of the system at large scales. Ref. presented numerical 
evidence for this observation, and showed that it enables one to obtain analytic estimates on 
the dependence of the memory formation and forgetting processes on system size and model 
parameters. 

This appendix has two subsections. In the first, we present an analytic bound on the 
difference between the configurations generated by the linear and nonlinear equations starting 
from the same initial conditions. This bound on the difference grows logarithmically with 
system size, which is very slowly indeed. Therefore, although the memories are absent in 
the linearized equation (indeed, the A(t) drop out entirely), the linearized equation yields a 
very accurate description of the system's behavior on large scales. 

The second subsection discusses the effect of the noise on the linearized map. We demon- 
strate that the difference between the configurations yielded by the nonlinear and the linear 
equations differ by no more than unity, and that this bound is saturated in some situations. 

A. Analytic bounds on behavior on large scales for the map without noise 

In this subsection we present an analytic bound on the error in the curvatures that is 
made when one approximates the full nonlinear Eq. (|3[) with the linearized version Eq. fl4"ED . 
As discussed in Ref. [II], numerically we observe that the error in the curvatures made by 
approximating the nonlinear equation with the linearized one is of order unity for all system 
sizes, boundary conditions, and initial conditions. The analytic bound presented here, valid 
for the k —>■ limit of the model, demonstrates that the difference between the configurations 



APPENDIX B: THE LINEARIZED MAP 



cj(t + 1) - cjit) = k [c j+1 (t) - 2 Cj (t) + c,-_ x (f)] 



(46) 
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of the two equations is bounded by an amount independent of time and which increases only 
logarithmically with the size of the system. This result provides further evidence that the 
long wavelength behavior of the nonlinear equations (though not the memory formation 
itself) can be estimately accurately using the linearized equations. 

We proceed by writing the equation of motion for the nonlinear system, Eq. ([!]), in the 
limit k = as 

^ = c J+1 (t) - 2 Cj (t) + Cj-itt) - (S j+1 (t) - 25 3 {t) + Sj-^t)) , (47) 

where Sj(t) = frac(cj — A(t)) — 1/2. The definition of frac, the fractional part function, 
implies that —1/2 < 5j(t) < 1/2 for all j and t. For brevity, here we drop the tilde and use 
t to denote a continuous time variable. We compare the solution to Eq. ( [47] ) to that of the 
(linear) equation where Sj(t) = for all j and t, starting from the same initial conditions. 
We denote the solution to the nonlinear equation Cj(t) and the solution to the linearized 
equation as lj(t). 
We define 

A q (t) = ^=J2^c J (t), (48) 

= 4s E^*i(*) , (49) 
ViV j 

and Fourier transform Eq. (fT7D, obtaining 

-u q (A q (t) - B q (t)) , (50) 



dA q {t) 



dt 

with u q = 2(1 — cosg). This equation has the solution pT 



A q {t) = e-^A q (t = 0) + Wge-"** f dt'e^' B q (t') . (51) 

Note that the first term on the right hand side of Eq. ( |5"T| ) is just lj(t), the solution to 
linearized equation with 5 = 0. Therefore, if we define the deviations from the linearized 
solutions 

Ac j (t) = c j {t)-l j (t) (52) 

and 

AA q (t) = A q (t)-^=J2^ j lM, (53) 

then 

AA q (t) = u q e- u '* ! dt'e^'Bgit') . (54) 

J 
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Fourier transforming, we obtain 

1 



A Cj (t) 



N 



EE 

j> q 
•t 



Y f f Q dt'5 r {t')^G 3 ^{t-t'), 



dt'e^'Sfit') 



where 



Gj—j/(t — £') 



iy e *'-i) e ^C'-') 
N ^ 



(55) 
(56) 

(57) 



is the Green's function specifying the response at site j and time t to a disturbance at site 
f and time t' [|22],[23|. 

To proceed further, we investigate the the Green's function, Eq. (|57|). Up to now our 



manipulations have been exact for any length chain, but now we specialize to the case of 
long chains, for which the sum over q can be replaced by an integral, yielding (Ref. |[24|| , 
9.6.19): 



-2t 



(58) 



where I u (x) is the modified Bessel function of the first kind of order v. If j' = j, then Gj-j>(r) 
monotonically decreases from 1 to as r goes from to oo, while for j' ^ j, Gj-jt(r) has a 
single maximum as a function of r; it rises from zero to a maximum value and then decreases 
back to zero at large r. At large distances and long times, the contribution of large g's is 
suppressed exponentially, so that it is very accurate to approximate u q with its small q limit, 



~ Q 2 -! yielding the Green's function PB" 



Gj—ji (t — t ) 



4vr(t - 1') 



exp 



if ~ jf 
4(f - t>) 



(59) 



This function has its maximum when (t-f) = j 2 /2, with the value G*,_j = (y2ne\j-j'\y 

The simple behavior of the G"s, together with the bounds —1/2 < 5j>(t f ) < 1/2 for all j' 
and t', can be used to bound |Acj|. The absolute value of the right hand side of Eq. (|56[) is 
maximized if 5 = 1/2 whenever the time derivative of G is positive, and 5 = —1/2 whenever 
the time derivative of G is negative. Thus, one obtains the bound for long chains: 



|A Ci (t)|<l + £G* 



3 3 



3' ft 



^I + ^v^Ij-j'I)- 1 

j'ft 

oc ln(JV) , 



(60) 



where, again, iV is the length of the chain. In more dimensions, a similar calculation yields 
the result that the bound grows logarithmically with the linear dimension of the system. 
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Thus, the linearized map deviates from the exact solution by an amount that is bounded at 
all times by an amount that grows very slowly with system size. The deviations observed 
numerically are smaller than this bound; this is not surprising because the bound is obtained 
for a particular choice of correlated 8's, which is unlikely to be generated by the dynamics. 



B. Linearized Map With Noise 

A bit more insight into the linearized equation can be obtained by investigating the long- 
time behavior of the linearized map with noise added for the "nailed" boundary condition. 
We show that the difference between the curvature values in the linearized solution and the 
nonlinear solution is bounded above by an amount of order unity. 

We start with Eq. (p~3| ) together with Eq. flTT|), yielding 

1 to+ T av e — 1 -y- j 

E floor[cj-(*) - A(t)} = J2 p n- (61) 



T ^ T 



We linearize this equation by replacing floor(;?) — > z — | and obtain 



2 

—p I 

„iinear 

T n=l Z 



J2 P n + A + ~. (62) 



We can compare this result with that for the nonlinear equations. To do this, we can use 
the bound C 3 < c Y nlinear {t) < Cj + 1 (recall Cj(t) =C + 5cj(t), with < 8cj(t) < 1), and cast 
Eq. ( pop as the inequality 

X j 1 M 

c nonlinear^ < E P « + T?E ^OOl[A m ] + 1 < c ^~(t) + 1 . (63) 

T n=l ™ m=l 

Using the inequalities x — 1 < floor [x] < x, we find 



^nonlinear ^ ^linear _|_ _ 
3 "'2 

c nonlinear^ > JAnear _ _ _ (54) 



The difference between c l - near and Cj onhnear is thus bounded by an amount of order unity even 
as the system size iV — ► oo. Thus, though once again the linearized model does not yield 
information about the memory values exhibited by the system, it does provide an accurate 
description of the large scale variations of the configuration. 
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FIGURES 

1.0 i 1 r 




50 100 

k*t 

FIG. 1. Plot of curvatures Cj(t) = k(xj + i(t) — 2xj(t) + Xj-\(t)) versus scaled time variable k * t 
for Eqs. (jl|) with no noise and boundary conditions xo(t) = 0, XN+i(t) = xjy(t), starting from the 
initial condition Xj(t = 0) = for j = 1, ... ,N. System parameters are given on the plot. The 
horizontal regions in the graphs occur when the fractional part of one of the curvature values equals 
the fractional part of one of the values of A. Notice that while the balls spend some time on each 
of the memory values, all the curvature values eventually end up at the single memory value 0.9. 
Inset: sketch of balls and springs in periodic potential, a physical realization of Eqs. ([]]). 
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FIG. 2. Effect of adding noise to the system of Figure |], again starting from the initial condition 
Xj(t = 0) = for j = 1, . . . , N. On each panel the curves from top to bottom are ci(t), . . ., cs(t). 
Unlike the case without noise, four memory values (0.9, 0.7, 0.5, and 0.3) all appear to persist out 
to long times. In (a), one of the curvature variables fluctuates far from memory values, indicating 
that noise can destabilize as well as stabilize memories. In (b), the parameter k has been reduced, 
with all other parameters held fixed; here, the fluctuations in the curvatures are much smaller. 
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FIG. 3. Time evolution of the curvatures in a system of five particles (N = 5) in the presence 
of deterministic "noise." Except for order of the sequence of noise kicks, the system is identical to 
that in Fig. |2|(a). The curves from top to bottom are c\(t), . . ., 05(f). Note the similarity in the 
large scale features of these curves, where deterministic noise has been applied, with those with 
random noise, shown in Fig. 0. 



26 




FIG. 4. Plot of two curvatures in the system of Figure || versus time on an expanded scale. Pa- 
rameter values are k = 0.001, N = 5, A = [0.1,0.3,0.5,0.7,0.9], X = 9, r = 13, with deterministic 
noise. The plots show c\ and C2 versus time after the long-term behavior has been reached. The 
behavior is periodic; the period is 65 time steps, the length of one noise cycle for N = 5 and r = 13. 
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FIG. 5. Numerical results for the curvature values observed at long times as a function of 
the parameter X/t for a system with N = 3 and deterministic noise. For these computations 
k = 0.0003, but the results are insensitive to k when k is small. The solid lines are the analytical 
prediction for these curvature values using Eqs. (|2l 



and (17). The number and value of the stable 
memory values for given X/t can be read from the graph, keeping in mind that curvature values 
which differ by an integer are on the same memory. For example, for X/t = 3, c\ ~ 1.3, C2 ~ 0.3, 
and C3 ~ —0.7, so there is one stable memory for these parameter values. Other choices of X/t 
(such as X/t = 1.1) yield more stable memories. 
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FIG. 6. Plot of curvatures versus time on an expanded scale during the evolution of the noiseless 
system of Figure [j]. Parameter values are k = 0.001, N = 5, A = [0.1, 0.3, 0.5, 0.7, 0.9]. The particles 
can be divided into two types — those whose curvatures oscillate periodically in time about memory 
values (for one case, C5, the curvature on the memory is actually time- independent until C4 hits a 
memory at t ~ 8660), and those in transit between memory values. 
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